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ABSTRACT 

This paper describes a study which utilized Kitchener 
and King's (1985) Reflective Judgment model to assess levels of * 
reflectivity in 80 undergraduate students at Southern Illinois 
University, Carbondale, before and after taking a one-semester 
general studies course with an environmental focus. A curricular 
intervention was designed to help students examine their epistemic 
perspectives. One treatment and two control groups were used. All 
participants were individually administered Kitchener and King's 
Reflective Judgment Interview (RJI) , For the first time in reflective 
judgment research, this study demonstrated that a purposefully 
structured one~semester intervention can result in epistemic 
development. Those students who were exposed to the one-semester 
developmental instruction approach had significantly higher 
reflective judgment change scores in comparison to students who were 
not exposed to such an approach. This study involved the development 
and implementation of the Reflective Judgment-Developmental 
Instruction Model (RJ-DIM) (Kronholm, 1993), and this pedagogical 
approach can be credited for the positive gains found. (Contains 5 
tables and 32 references.) (Author/SLD) 
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The major purpose of institutions of higher education, as 
consistently stressed in the mission statements, is the 
development of individuals who have the capacity to make 
independent, reasoned judgments about the complex problems of 
modern society (Welfel & Davison, 1986). Inability to make such 
independent, reasoned judgments may result in graduates who are 
incapable of participating as informed and fully functioning 
citizens in their society and the world. Trow (1989) asserted 
that one objective of higher education was to give us citizens 
with "quality of mind" (p. i 8 ). it was his contention that higher 
education promoted students' intellectual growth by the emphasis 
placed on learning how to think. Damon (1990) warned that schools 
cannot treat their students as passive receptacles into which 
learning can be poured. He emphatically stated: "Whatever else 
they may try to accomplish, colleges and universities share a 
central goal: fostering their students' intellectual growth" (p. 
A48). This intellectual growth, in the form of students' improved 
capacity as critically thinking persons who are capable of 
reflective judgment, should be a primary goal for higher 
education. 

With the utilization of Kitchener and King's Reflective 
Judgment model (1985), levels of reflectivity in undergraduate 
students were assessed before and after taking a one semester 
general studies course with an environmental issues focus. The 
treatment section of the course, Living in the Environment , was 
designed to help students examine their own epistemic perspectives 
by challenging them to come to grips with a variety of 
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controversial issues or ill-structured problems dealing with 
topics such as pollution, nuclear power, and toxic waste disposal. 

The Reflective Judgment model developed by King (1977) and 
Kitchener (1977) suggests one vision of higher order reasoning, 
reflective judgment, and how it evolves (see Table 1). Kitchener 
and King argued that the Reflective Judgment model measures only 
one aspect of critical thinking, that aspect which involves ill- 
structured problem solving (Kitchener, King, Wood, & Davison, 
1989). According to Kitchener (1992), the process of learning to 
think and reason more effectively, as described in the Reflective 
Judgment model developed' by King and Kitchener in 1977, is based 
on four concepts which are assumed to be valid. 

1. Individuals actively attempt to interpret and make 
sense of what they experience. A personal, internal 
logic exists; 

2. Over time, people develop ways of making meaning. 
New, more mature meanings should replace earlier 
forms; 

3. An individual's development is affected by interaction 
with the environment, providing that stimulation and 
support are present; and 

4. Individuals do not function "in a stage" (p. 6). 
Rather, individuals tend to exhibit a range of 
responses across stages, according to a number of 
factors, including the "type of feedback and support- 
provided (p. 7). 
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The Pedagogical Approach 
For this study, the researcher developed and implemented a 
new teaching model, the Reflective Judgment-Developmental 
instruction Model (RJ-DIM) (Kronholm, 1993). The model was 
created as a result of the synergistic efforts of other 
researchers interested in cognitive development and developmental 
instruction. The RJ-DIM is based on the work of Dewey (1933), 
Perry (1970), Piaget (1970), Kohlberg (1984, 1987), Knefelkamp 
(1981), and Kitchener and King (1985, 1990a). Aspects of Dewey's 
and Perry's work on how students think, Piaget 's ideas on 
disequilibrium, Kohlberg 's Plus one rule, Knefelkamp 's work on 
developmental instruction, and Kitchener and King's research on 
reflective judgment were combined to. create an innovative 
pedagogical approach aimed at changing how a student processes 
information, understands, and subsequently solves problems. 
Therefore, the power of this paradigm lies in its synthesis and 
blending of several educational theories and educational models. 

Orientatio n to the Reflective Judoment- 
Develoomenh al Instruction Model (RJ-DIM) 

Syntax of the Model 

In terms of a holistic view of the Reflective Judgment- 
Developmental Instruction Model (RJ-DIM) (Kronholm, 1993), it can 
be seen that the concept is grounded in the energy of the group 
and capitalizes on the potential that comes from differing points 
of view and perspectives. This is accomplished through carefully 
sequenced phases (see Table 2). 
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Table 2 

Syntax of the Reflective Judgment-Developmental Instruction Model 



Phase Activity 

One: Orientation: 

Introduction to the issue. Pros and cons of the problem are explored. 

Two: Students take a stand. 

Focused questions are asked which encourage students to think about their 
epistemic perspectives. 

j 

I 

Three: Students have the opportunity to articulate their epistemic perspectives j 

in writing. 

i 

J 

I 

Four: Optional Phase: i 

Opportunities where students have a chance to share their epistemic 
perspectives in pairs or small groups. ■ 



Five: Discussion based on the Plus One rule and disequilibrium. 



Six: Students are left with unanswered epistemo logical questions involving tlu 

i 1 1 -structured problem. 

Some students may want to continue exploring or investigating the issuf; 
independently. 



Seven: Retrospective reflection:, 

Topics of discussion are revisited as time allows. 

Note . a From M. M. Kronholm, (1993), The Impact of a Developmental Instruction App ro i ch to 
Environmental Education at the Undergraduate Level on the Development of Reflective " 
Judgement , p. 57. Ann Arbor, MI: Universi ty Microf i Ims. 
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In Phase One, the introduction of an ill-structured problem 
or issue is presented. Students are given ample time to explore 
and discuss the issue. Resources might include guest speakers who 
espouse diametrically opposing viewpoints. Supporting materials, 
such as videos, newspaper and magazine articles, and current 
books, also help students to analyze, evaluate, and reflect on 
both sides of the issue. 

In Phase Two, the students take a stand on the issue. The 
instructor asks focused questions which act as a catalyst to 
encourage students to think about their epistemic perspectives 
regarding the stance taken. Questions might include: Who do you 
think is right? How do you decide who is right? Who are the 
reliable experts in this issue? How do you judge the reliability 
of an expert? How do you decide who to believe? How do we know? 
Can we know for sure? with what degree of certainty can we know? 
What makes one view more compelling than another? 

In Phase Three, students are given an opportunity to 
articulate their epistemic perspectives in writing. In guided 
practice, the teacher monitors the students as they work, provides 
additional information as needed, clarifies questions, and gives 
positive feedback. m independent practice, the students work 
individually to formulate and organize their thoughts and ideas. 
In both instances, the students' written responses are collected 
after the discussion, in order to: 
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give the instructor a chance to target interventions 
on a one-to-one level, via written feedback* 
allow xeroxed copies of the answers to be made and 
placed in each student's class folder* Hence, over 
time, the instructor will accumulate portfolios which 
map out each individual's cognitive development* 
According to Thompson (1990): 

Portfolio materials represent performance in actual 
learning processes and show how students work on 
substantive academic problems, rather than in 
artificial testing situations* Portfolio evaluation 
can be developmental rather than distracting or 
intrusive, because preparing portfolio documents can 
be an important learning experience in itself* (p* 6) 

give the instructor an opportunity to compile a set of 

student excerpts, which represent a variety of 

reflective judgment levels and can be used later as a 

focused discussion tool* Anonymity is honored so that 

students will not feel inhibited in the completion and 

submission of their written responses* 

Phase Four of the model is an optional step. In this phase, 

students are given the chance to share their epistemic 

perspectives, in pairs or in small groups, prior to the large 

group class discussion. Students, who are sometimes hesitant to 

share their thoughts and perspectives in large group settings, may 

feel less inhibited if placed in small groups. Ideally, these 

groups should be carefully planned in terms of participants. For 

optimal results, students should be at dissimilar levels of 

reflective judgment. It is important to note that the instructor 

loses some control in Phase Four. Students in the small groups 
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may lose their epistemological r focus and, instead, broaden the 
focus to a more general discussion of the issue. This loss of 
focus is to be expected and the teacher should be prepared to 
refocus groups as needed. if the class size is too small, if time 
considerations make this phase prohibitive, or if the control 
issue is a concern, the instructor may elect to move directly to 
Phase Five. 

In Phase Five, the class discusses the focused questions. 

The answers and comments disclosed earlier provide the teacher 

with clues about the students' epistemological perspectives. Once 

an individual student's typical reasoning style is identified, the 

educator can then target his or her interventions one stage 

higher, using the Plus One rule (Arbuthnot & Faust, 1981). The 

Plus One rule holds that a student can understand and appreciate a 

position which is no more than one stage above his/her current 

level. However, discourse from more than one stage above current 

reasoning cannot be assimilated or accommodated by the student. 

It is important to note that the Plus One rule promotes 

disequilibrium, an important aspect in this fifth phase of the 

model. According to Joyce and Weil (1986), disequilibrium is a 

precursor to developmental change: 

Our nature as learners contains an interesting 
contradiction: Important growth requires change. We have 
to give up our comfortable ways of thinking and survive the 
buffets of taking on unfamiliar ideas, skills, and values. 
The need to grow is built into the fiber of our being. We 
are impelled upward in a developmental sense. 
Paradoxically, however, we have an ingrained tendency to 
conserve our beings as they are or were. Nostalgia is, in 
fact, a yearning not to have grown or changed. We would 
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like to go on and see things the way we were when we were 
young and untutored. Curiously, the answer is to produce 
disequilibrium — to create environments that impel us to 
change, not discarding what we were at any given stage, but 
learning to build on it productively, . . The learner needs 
to confront problems and diverse opinions in order to reach 
beyond the present stage and develop the constructs that 
will sustain growth at another level, (p. 447) 

In Phase Six of the model, students are left with 

unanswered, epistemological questions. The typical closure to a 

discussion is purposefully lacking in this model, in order to 

stimulate cognitive conflict and encourage reflection. Right 

answers are not and cannot be given. This ambiguity reinforces 

the idea that significant learning is frequently accompanied by 

discomfort. As Joyce and Weil (1986) emphasized: 

If the environment is too comfortable or * reliable' the 
learners may be satisfied at the stage of concrete thinking, 
where the ability to integrate new information and form new 
conceptual systems is limited indeed. To impel learners to 
diverge from the familiar sets of concepts that enable them 
to view the world in ^blacks and whites,' the environment 
must be dissatinf ying in some ways. (p. 438) 

This dissatisfaction, however, must be offset with support. It is 
imperative that the instructor be nurturing and caring if students 
are to successfully cope with both the cognitive and affective 
dissonance which may ensue. In addition, it is desirable that the 
instructor be one who can support and encourage learner autonomy. 
Some students may want to continue an exploration of the 
ill-structured problem independently, because knowledge-seeking 
behavior is easily aroused and strongly reinforced by the RJ-DIM 
(Kronholm, 1993) . 

In Phase Seven of the model, topics of discussion are 
revisited. If cognitive development has occurred, retrospective 
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reflection gives students an opportunity to use new epistemic 
filters to view the ill-structured problems which were explored 
earlier in the course. 

Social system. The RJ-DIM (Kronholm, 1993) is highly 
structured. The model begins with the introduction of an 
ill-structured problem or issue and leads to an exploration of the 
problem or issue, followed by very specific and focused questions, 
aimed at encouraging students to think about thsir epistemic 
assumptions. Therefore, in contrast to other pedagogical 
approaches such as the Jurisprudential Inquiry Model (Joyce & 
Weil, 1986) and moral education simulations or discussions 
(Arbuthnot & Faust, 1981; Hersh, Paolitto, & Reimer, 1979), the 
RJ-DIM. is not solely focused on issues in relation to public 
policy nor a redefinition of social values, per se. Similar to 
the Socratic dialogue (Joyce & Weil, 1986), the scope of the RJ- 
DIM is broader and, in particular, the goal is to encourage 
further cognitive development. The model concludes with a 
discussion that helps students explore their own and others' 
epistemic perspectives. An important caveat regarding the RJ-DIM: 
The teacher should be careful that a generic discussion of the 
issue does not become the focus of the activity. Instead, he or 
she should aim to turn the students toward an examination and 
reflection on their epistemic viewpoints as they relate to the 
issue. 

The following social system variables are needed if the 
RJ-DIM (Kronholm, 1993) is to be successful. 
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1. A teacher who has a thorough understanding of 
developmental theory, 

2. A teacher who is competent in the facilitation of an 
open, supportive, and accepting social climate. 

3. A teacher who is willing to give up the role of an 
all-knowing authority. 

In order to assess the higher order thinking that the model 
purports to cultivate, the teacher may want to have an outside 
observer use an on-site evaluation tool to provide information on 
the extent to which the RJ-DIM (Kronholm, 1993), and the 
instructor implementing it, promote classroom thought f ulness. 
Structured observations can give the teacher the support and 
challenges required for the development and refinement of his or 
her instructional skills. Encouragement and feedback are 
important because, "the instructional skills necessary to lead 
open and productive discussions are among the most difficult to 
learn and complex to implement in any teacher's repertoire" 
(Leming, 1992, p. 149), 

The support system. Support materials for the RJ-DIM 
(Kronholm, 1993) include up-to-date books, newspaper articles, 
magazine stories, and audio-visual materials which present both 
the pros and cons of ill-structured problems or issues* Examples 
of books that were used in this research included: T. D. 
Goldfarb's (1991), Taking Si des: Clashing Views on Controversial 
Environment Issues; J . Allen's (1991), Annual Editions- ■ 
Environmental Ye arbook 91/92 : and G. T. Miller Jr.'s (1990), 
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Living in the Environmen t: An Introduction to Environmental 
Science , Guest speakers, who represent opposing viewpoints, may 
also be invited to the classroom. 

Support materials, in the form of video programs, are 
available from a wide variety of sources. For example, the Agency 
for Instructional Technology, Bloomington, Indiana has created a 
series of programs, classified as Interactions in Science and 
Society. Two of these 20 minute videos, Acid Rain and Genetic 
Engineering, were used in this current research. 

When current books, newspapers articles, magazine stories, 
and video programs are not readily available, the instructor may 
want to construct briefing sheets which outline the conflicting 
viewpoints for a given issue. Although this current research was 
focused on environmental issues, ill-structured problems can be 
found in a wide array of disciplines, including the social 
sciences, business, and humanities. 

The optimal support system for the RJ-DIM (Kronholm, 1993) 
is premised upon a teacher who is well-grounded in developmental 
theory, especially as it relates to reflective judgment. In order 
to develop stage-appropriate tasks, the teacher should have a 
thorough understanding of the Reflective Judgment Model (Kitchener 
& King, 1985). This model is discussed later under the section, 
Instrumentation. 

Finally, a classroom that is physically conducive to large 
and small group discussions is necessary. This means a classroom 
where the chairs or desks can be easily moved into one large 
circle or groupings of several small circles. 
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Principles of reaction . In the RJ-DIM (Kronholm, 1993), the 
teacher must create a supportive environment so that students feel 
free to respond. The teacher ;.iust be careful that discussion of 
the issue does not become the focal point of the activity. The 
issue is merely a vehicle to encourage students to examine and 
reflect on their epistemic perspectives. 

To utilize the RJ-DIM (Kronholm, 1993), the instructor 
selects the ill-structured problem to be explored and then 
carefully formulates the focal questions which relate to that 
problem. It is important that the instructor recognizee the need 
to respond to students in a carefully thought-out manner, For 
this model co work effectively, several requirements are 
necessary. 

1. The teacher must be able to help the students 
recognize and contrast alternative points of view. 
Through reflection, paraphrasing, or summarization of 
student responses, the teacher increases students' 
awareness of their own views and feelings. 

2. The teacher must be able to anticipate students' 
answers and must be prepared to challenge and probe. 

3. The questioning of assumptions must be tempered with 
supportiveness. Also, the teacher's comments should 
encourage free and honest expression of ideas, 
feelings, and opinions. 

4- Teachers should be able to help the students clarify 
their positions, understand their assumptions, and 
communicate more effectively with one another. 
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5. Teachers should be willing to model how they think. 

6. The reactions of the teacher are primarily those of a 
facilitator. He or she must maintain a nonevaluative 
but supportive attitude and offer appropriate 
stimulating comments at the right moment. 

The following summary chart serves to briefly describe and 
summarize the operational heart of the RJ-DIM (Kronholm, 1993) 
(see Table 3). The seven phases are reviewed as well as the 
requisite factors of social system, principles of reaction, and 
support system. Additional aspects of the model are modes of 
application and instructional and nurturant effects. 

Application. The RJ-DIM (Kronholm, 1993) is based on the 
work of Kitchener and King (see Table 1). A more detailed 
explication of the developmental sequence for Reflective Judgment 
was developed by Kitchener and King (1990b) and is presented in 
Table 4. 

Kitchener and King (1990b) believe that, not only is it 
possible to influence a student's level of reflective judgment, 
but that it is important to organize instruction with development 
as a guiding principle. The important conditions seem to be: 

1. interventions targeted no more than one or two stages 
higher than where the student typically responds; 

2. disequilibrium or exposure to contradictions in the 
student ' s current perspectives; 

3. use of a teaching style and textbooks that do not 
promote the facade of touting absolute truth; and 



17 



A Developmental Instruction Approach 



16 



4-> CU *-> — 

*-> <T3 E 

co rax: cu cu 

•« » +-»•»-» M 

CU <0 (/) 
(1) L. COM— 

— i— c— a 
o o o— ' cu 
t- o— 

COTJ CO <"3 CO 

— C a) 

I- CO 3 C 
<U 0"04| 

fP CO CD"QM 
CU CO U C CO 
M— O CO 

ail E cn 
h- x:— cu 

— ' O t- CO 
TJjQ C/> Q_C 

Si*?- 

M O 1 ' 

Co *-» </) L-— • 
O CO M CO 

>OM com cu 
— «£- • co> 

xtmcu— »x:— 

._ , (D— O 

x:— o cu 
</y •— o_c to 

— 0 4J W L 
<DL C CU 

— x: ao o a. 

CU M Q>->— 
■D CO tO O) 
QM i CJW5C 

£ o cum 3— 
a o>co o c 

cu— CO— ' CO CO 
£l)4J CU— CU 

1— c/) c/) t-"D £ 



C-Q 

■- o 

4-> L. 

CO 3 
GJ 4-J 
t- O 
CU 3 



c— » 

^ CU*3 
M C0*- 
C0 o 

*jx:— 
eo o c 
x: co 

o _ 
m i_tj 
o cue 
CTJ co 

L. 
O OM 
M C 

C CO 

M— > 
C 0) 

CO >— ' 
■M C- CU 
C- CO L. 
Q CO 
Q.C0 CU 
E CU C 
••— CJ CO 

CO C*JZ 

•— o 

CU— 
■M 5 — C 
— COS 



CO 
CU 

> 

C CU '£ 
— x: O Q. 

I- Q.CU— 
CU — f Q.CU 

g cu 00 -c 
c »x:c_ 

CU CU CU o 

MMTj OjM 
Q-E CO O CO • 

E— — co <o 
O— cu 6 c 

CJ (J (J CU >*0 
CM CO— 
CO—' CU CO X C 

"S— 5*Q.co Q. 
cu o 6 cu o 

COCO JZ 

cu aic 0 co co 
x: cmx: _ 

O— M C CO 

co-mcu — «#- 
CU o>j CU CU 

M CU Cfc CM— 

o— o— » 
cu o*-»**- (0 cu 
x; co*— O cux) 

"-g o— 
m cu o CM cu 

CO Q>-' CD JZ 

§0 COM 
co Cm 
C— O CU CU 
U CO — CU C 
O X) CU C— 
H-OJO > 

C— »CU t- CU 
*n— ~o cuTJ 
Cv CO JZ 
to CO* CO U CO 
*J <-4~> <0*-» 
— CU C CU C 

4-»wx: cu -m cu 
co*- o*u "Q 
c- o co 5 cu 3 

— CD 0*->JZ *-> 
U-H--M CO»— CO 



CU C 

x:-— 

C 



CCU 
O 3 

— cr 

CO 

cox: 
cu cn 

COD 
O 
CO t- 
cox: 
to*-» 

o » 

«"8 

x: to 



c- CO 

cu 

xzw 

CO O CO 
CU— D 

*>**•> u 
co O 

*-» 0*CU 

x: 

CU o 



CO >— ' 
CO-M XI 
CU CO 

CJZ CO 
— i+J CU 



4J O-M >» 



v»- L. CO 0> X)—« cu 
O O CO"Q CO cu cu 
O co 3 L.*OJQ C u 



XO-/VOCO 
4-» o cox: co t- cu C0H- 

» o*-at- 

CO CO cu cu O co o 3 cu 
lcxx co tot. o±> 
cu o *-» *-»x: cu— t- c 

>— U*D O O)— 

— 4-» o> »cej— co 

OtDCCOCU — COCU-M 

c cux: ^x: o 

CO— co to— CO »Q 
CU CO C- CO IX « (0 C0TJ 

— t- 3 O CU t_ C 
-co o O x c_— O >. 

— CO to CO V cu CO— cu ■ 
> cu C— t- xrx: cox: 
— -a cu~0 u-o co-m 
*-*a >CtO 3 
ux) >hQ.C co o cu u-m 
cocu<m3^o ex: co co 

t>- o u co <m -m— x: 

■JwwL CU CO "D*J 

eop!E °c?— cu ?C-0 
cu— cu 0 O— *— 3 co 
co ox a» >-Q 2>o 

J^COCUUO OCLV • 

tO t ' QOLVCaOX-O) 

CO IJu • L. L. CD C 

4J O CU O ( » Qt— 

o "O ox:*t co— co c 
cu C • C ■»-»•»-< £ m u 
O XEx: co 



co • cu enc 
— to o— '— » c _ 

U— *-»— »X)— COTJ I 

Q. cucacocfl cu< 

O co E — C >^ cu- 



J) C CO— c 

Q.O CO X} C- — »«- CU 

S.C cux: cox: c cox: 
a cu 3-m o-m C o oh-w 

-0^35 CD— ^ 



7)Q4-> 3 O CO— 
O CU t- OX1 O— CU 
QO>CU— ' Tlx: C+"*— XJ^_ 

a co Q-co «- cu w— coti o 
3 M x— o c— 0-<P"O o CO 
co to CUT?"- C X OXJ C0<M cu 



"8 



o 

cu c 



CO CO 



8*, 

COX} 
3 CO 

2„ 



N CU 
CO— 

co> 



co4-»t3 
•X o— 
o— > 

0^0 

Xl v «- (- 

ca 

CU O 
•M o cu 
CO X3 

. CXJ 
o cu— » 

C0 3 

. 00 

Q.LX 

3 Q-CO 



8 



1 



^cu 

CO t- 
Cfl 

CO co 



CO 3 

ul 

u cu 
o 

Q.CU 
X M 

cu >• 

CU CD 

I— c 

CO CD 

• CU O CU 

3 CO (0 
CO CO CU CO 

to— E— 

<U4J CU 

•>j=^x: 

!S« IT 
Om- 0-0 

— O O) 
W CO CO 

ssse-s 

6— U CO— 
*•» to 

»C- C0XJX1 



• C- COXJJ 
■MOD 

— a.c/i o 



— ^ to 

CO 4-1 
~P 3 C • 
CU U CUTJ 

> OTJ CU 
— 'U- 3JX 
O CO 

> CO CD 

c • 

— co cncu 

CCL 

S3 CU CO 
CD— 0)CU 

Eo^> 

COC— 

» .— 

CO cu u 

^X>«CL 

— >.(0 
4-« CO— » t- 

. CO CO cu 
*-* Q *-* CL 
tO Q.C0 

u u 
t0 4-» ro*-» 

CO CO CO 

CO CD O CU 
4-» > CO 
CO CU L. 

x:— 

CO L. U CU 

o— x: 
cu sz*-> 

-X CO 3 
CO C 4-» 
♦>— »3 
N CO O 

• •to— cn 

p4-» tO O CD 

3 c cu— 

"O-M CO C 

CJ 3 c cu— 

S3X 



55 c c § 

CU *" O 
>co o • 
CO cu +-*•— to 
• •x:> to— c 
fj — x: o o 

cu CO *•* *-»»*— 
Uv u *-> CO 
JC C CU O t- to 
H- CU O.CO O 3 
TJ CO Q.U 
CO 



I 4-* CU CD 00" 

len Q.V. — 



CU— 

o— 

C Q 
<o E 

JZ CO 

o 

c • 

CD— C 

o 

cu t-— 

> O CO 



TJC tO 

3— to 

4- J CO 

CO CO— 

cu u 
cu > 

u— a. 

CU4J 3 



"8 l o 
TJ ju^cn 



C a Sx: 

(O 

C I— CO 
O CO— o 
— CU-» 
4-> CO (U 
Q.CU t_ 

o— t- o 



♦J to 
ll. t_ cu a. 

cu a. co o 
to Sx c_ 
coo co cn 

f 



t 

to 
TJ 

■g 

CO 

cu 
"3 



c 

o 



CL 

cu 



§4J 8 TJ 

— o cu cu 

4-»— OX t_ 
CO — ' *-> 
CUH- 3 

s-irsSr 

u t. 

— x: C 

CO CUM O-M 

o > X- o 

— O M C 

COM L. CD 
O— D)LX 

— C o cn 

§cn— '— 3 
O CO Q-O 
om xx: 

M C CUM 

CO « 

Q.E Q."coTj" 

cu <5 o c cu 
— o cn 

TJ-Q CU— CO 
cu O >M t_ 
U £_ CU— 3 

j.ao|8 

COTJM- CO C 
C CU— CU 

co l. cn 

C3SCC0 
3MU— — 

O coT) _ 
x: 3 to t- E 

4*> I_ CO CD CU 

*-> <u cn— 

2(0 O CU-Q 

♦^.8 *■? 

»*-— >a. 

cu«— cu E 

~ ' cu to c"8 
cux: o t- 

LWV 3 
CO t- 3M 

cno co c> 

• •COCO. 3 
Km— Op c- 
C> 3 C ^ 

i/i cu-- to cu to 

cu^ >-gl5— 
com c Cm- 
co c/;— cow— 

f 



o to C 
to o 



94 



CO 



0 

ERIC 



A Developmental Instruction Approach 

17 



COTJ >» 
<1> 01 — i 

£2 s 

OOMM >- 
JQO<0— » 

o i" rn 
eg 

&8a>"8 
.CAT) a. 

QuCD— CO 

oo 

M -CUH- 

CO CO 

Scow 
mco> 

L. 

E 0)TJ 3. 

cdm 



otjc 

0) > 

-»cbo> 

cd co 
i-rj coco 

O — 

2\o cox 
to— »- 
mx» x 



— ' CO L- CO CD 

>*o « w 
xc cd 

<D to C0>— 
MO) (A£C M 

com cdm *— ' 
m— » £-c o 

3 to ai co— t- 

>w«)LOO 
COCO— »«J MM 

to cd o 
m u orO o» 
-c Q mmtjd 

MC'"* C 

2cof2ySoM 

.8 

OJ.Csw'*-' M U 

— »m cow 

•— 3 >^0*-« <D CO 
_C t_ L. O — M 
3MU (OLC 
CD CO— OLV 

■MO 10 4) O 
flJC J§— 'I-m 

jo— -tjooico 

4-»</> CO— UX: 
CD > oo> 

CD C— CO CO CO 



COCCO loo 

"RSc'S -° 

col. t-XarfcDOj 
— 'AllO — * £ 
g>- c 0)0.5 

■§«vsf" 

— O— '4> >CC 

>moj}m<dco 

£ (J 3 
■DC XCL.O 

c 5 to— »m ox 

••-QUO) H-4-» 

ccdmo — ' 

o ^t"> 
c>-o- COM - 

•. • M C/>— CO 

co a) a*-* <o 

m--3 oc 
axo*— xcti 

arq j gj-c 3 co 
m i> E^tgft) 
cog co 

Eh-x: -C 
co— o>mO) 

y^ij 5xi 

M 0) 

<Q>- -C _ - 
—**->*-> co— >. 

M CI 
CD— o o c_ o 

XLLC V 

o—- <u i—> 

— "O CO CO CO 

§. *o COCO 
iOL CL 

o ro co 5. 

M > •— M 

0>g 0)$>0>X: 




«4) 4-* 
C>0 C 

• — ■MO) — 
CL (0 

cd— to — * •*-» 
CO (0 (0 t_ GJ 
OWTJC -0)CO 
£LC5 oo> 
■mOXOCO • — » 
O L-MM — ' 
L. Ctl 0>C COO 

o 3 u a_a>x u 

*-M C 0 L. 

C O 3 SE-oco 
CD H— O CCU 
> CO CD CO >* 

o too UC 
cd.c cdm com 
-l_mx ceo 

CD (0 M Ol. 
— ' CL <0*^-«- 
^2 C— O 

4-» 3 
CO CU CO-C— ' L. 
CO fr-0)0 0 

0) »^x>»- CO 
o^t-m l. — • 

<0 3 £ C CO > o 
C L-OO—' <0LC 

co >»cu^r u 
cu <p CO 

L_ *U*-* CO — "•- 
CO X —.£-Q-C 
LOC C. 3 O 
OC-MO UH- 

Q v CU^ZH- Q.O 
E L.-M O 

55 co o 3 — 'co 

*J CJ C CO CO — ' L. 

•— O '«-<0<0 
C04J O>40 0) 

— c ra 

L.CC0LO— » 

jro- oo 

Eftiv] 

LDC0C8PE 
CO CD — ' •*-*-> 
H- O CM CO 
C0*>«- O— 'CO 

cocoC C 3-- 
O^r en cop 

U<ME U<P<ML> 
CO •— CO-— 

CD CD^ p— Mf 
E*«- OM M 
O--^ COC 
CO^^ g 3 O C 

C 5 ~^m"~ 

•♦- o «cp axo 

CDi EM 
4-)4->MM 3 C 
CO 3 CD >^C0 $ 

j: c t--^ 

*>*-m Q C <0 3 
CO EO M 
CD M CD O CD CO 

cm ocx: 

^ — 3 C COM 0) 
2> to—-— O • CD 
— EO CTJL. 

jt co >-c/>— <D^r 
5 >J3-*<- <n ci- 

C CD COM CDM»»- 

.*x: c— c co o 

O MM CD — -'-*-> CO 



0>*mC 
CD O CD 

yur 3. 
c m m cr 
o x: a; 

.— »C0L-TJ 
MC/>^4- CD 
(03—' U 
P£ CD 01 

E — co^m 

•— » M O 
— *>^CDC0 

— ' CO CD 
O— 'TJCO L. 

mco a>«- to 
c— 'x: 

TJUIM 
6 CD o 
mm Cm 
JX-^CO--' 
XI CD X) 

oco^ 

L_TjM — ' L. 
M CD CO CL 

>y CO > L. 

— 'to OTJm 
CO > CO 

3 a>-3 

COO)^ t- 

3i5a 



"S (0 3 C**~ 



m 6 o * 

CO— 'Xl CD <D CO 

Dt coxenu 

CO O CO COO 
CTJCM-- 
JZM CD COCO C 
M CO CD 




.— x:C— CD m — ' 
MOX »co wcl? 
•no t) " 
i> ft) E «— • 
Cf)3C-4> — ' 
TJWC0LC • O 
CD L_ CUM O O 
—'COOL <D 
3 SICD-.-M- 
O. w eoTJMO 

^"co C > tl— ' 

ub ft) o o id 
cotjm l_^t o 

— <+- Q>>"- 

» o ^ 3 a 

— — oco>> 

— •'OX-' M 
COC 01 *M 

JZ CO OM 
M H- CD CO 
•r~ « — CD Q 

C>^ m-*E 



Cmm"- 

L. CO CO CO • 

oc) cvr r cro 

COT? MM CDC 

— CCD > O 
to 3 coca C^ ft) >* 

CD CD— ' CO CM 

OC COCO CO 
*<— X O— 'C- 

gO. M CO CO 
M C 3 CO CD 

— CD CO— TJ — 



COMM |g^>— L. 

ai o E—"5 aic 

t-M-r-C CCM 

CD <5~o 8" &7 

4-»r- • CO CD 

Cm cot? coco j: 
— 3— »CU0)m 
— * CO CO ft) t- 

oo3 x: o 

M WTJ CD M^TM 

MM > C* 

O CO"- <D C CO 

ft) 



Xj >M 3 

jL CD «M 

coo - - g 

CO-^-- MCD >. 
COM-XM C— ' CD 

m c co colOx: 
C0>— — l-Om 
-xi_rz kll 

CO M ft) CO Q.C0 
Mftl » <0 

ujrft>«— » cd 

CD M > O «£Z CO 
O •— ftlMM 

Cm m co c- — ' 

S CD CO ^M-Q 
COXJ— '4> <0 

— coH-^r c~ " 



jcoop 

M CO CD 



CTJ &5>^m 

COH- C0X)M CO 

jgo 4 ~ 

■W ^ <*>M 

M CM^T ft)M CD 
CO CO OX£>3 C £ 

M L. O CO C— CO 
COOL. >f_ 

cd E cox: 3C 

>— CpMX o— 
CDC0T5__M 

-Q3 0)"O 

0) fO CO mX) , 

J5<] — 



mC— . XlOffO " COC 



CU(* LCD 
CO-—— o •— 

•«- toM^r 0) 



J— MM 

.oxi co 

" g 

oo>co 
M CUE <o o— 
CO— EcO c_ 
0> 0—0)3 0) • 

- ,<«—< L. O O CO 

~ toco CC 
0)0 
J CO 0)0-- 

C CO 5 E Smh- q. 
-co>4i— ' CD t 
C 0) l_mX)m l. 3 
)o CD coo <0 " 



0) 
CO 

to 



CO VIM _J VI 

— » co o >.a> 
en 0r+- • cdxJm 
3 u. cd co cox: 3 

>L>O)0>— -3 CO 
••- 0)JQ O— L. L. 
-nx: C CD CD M 

Cm CD CD CD > COCO 

— ox:tcn- 0) c 

M-- lO 0) 
-C > C— O— I- 
CD— C CD OJC O 
CO — 0)0 
CO CO CD CO >C CO 
M «MOC>"M 

CO >^c c o— 

— M C— • 

CO— CO CO CO— • ' 

— t_ E CO O (0 

x:o *o>— -o 

M.C >-M L-w— 
m CD (0 Q.C>-> CL 

m 3.c r Eg- >• 

< {D4-»M"-— 3M 



CD 
CO 

to 



C0)O<0 — 

'5S5-W30 
O 3 CO 3 Q CO 
C O OiJ CO 

^m— x: co ft) 

OjC 3 cOjC 
M CO — o 

>— "Q o 3 

—>ZM C— CO 

C m co*-; 
— — CL 
CO . >^0) • 
L_MM-* >- 

t- CD to C CO o 
0)3X^— <o 

t) OM CO CO E 
CC MtO— 

j y 0) L. (Dm 
3 <D t~— 
0) 0) COO Q-CO 
C c- t_ C X CD 
»— m to 3 



— > to 

CDOMCDC • 
XI t-CO Lm CO 

CD3^-0)M 
COM'^OM c 

*Omm— OM 

— to COM 3 CO 

>x:c-com 

— MOM 0) 
-Q CCX-M 

C co>uo - 

— CCO CL 
— o t- CO" 
-T>— 0)MC0 

0) CTJM»-- L. 
COCO— C C- CO 
COM •— Of 
M CO CD EH- 
CO CO o 
-imCO) 




— 'x; co c 
coco O CO 




CO 



— clc^ co am 

TJ CD OM 3 O 3 

C — O— ' M 
•«-MM 3 CO CO CO 



COM 0) CO — M 

M COC CO* 
— »t_ OCp ca3 u 
<: co ojd o co co 



c 

$ 

0) 
CO 

0) 
CO 

CO 



/ 

/ 



A Developmental Instruction Approach 

18 

4, an open and supportive social climate in which 

students can articulate and share their epistemic 
perspectives , 

In terms of specific educational practice, the first task is to 
learn about the students' current level of reflective judgment. 
This can be attempted through the use of carefully focused 
discussions and tasks focused on appropriate stage levels. 

According to Kitchener and King (1990b), they have not yet 
developed or tested a program designed to help students examine 
their own epistemic perspectives. The RJ-DIM (Kronholm, 1993), 
therefore, may be one of the most important outcomes of this 
current research. This model offers an approach that can 
systematically and purposefully challenge and support a student's 
current level of reasoning. 

Instructional and nurturant effects . Five instructional 
effects of the RJ-DIM (Kronholm, 1993) have been identified. The 
RJ-DIM; 

1. gives students a framework for the analysis of ill- 
structurev" problems or issues / 

2. permits students to make reflective judgments; 

3 . challenges epistemic assumptions , explores one ' s view 
of knowledge, and helps to develop epistemic meaning 
perspectives; 

4. increases an awareness and an understanding of 
alternative perspectives , promotes accurate 
perspective-taking; and 
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5» gives students facts about ill-structured problems or 
issues • 

Four nurturant effects of the RJ-DIM have been identified, 
also. The RJ-DIM: 

1* promotes open-mindedness, tolerance, and self-esteem; 

2, helps students realize the tentative nature of 
knowledge ; 

3, helps students to be comfortable in expressing their 
opinions ; and 

4, reinforces critical thinking skills used in the 
analysis of well-structured problems. 

Methodology 

The sample in this study consisted of 80 undergraduate 
students from Southern Illinois University at Carbondale, A total 
of 80 students participated in one of three groups; 28 students 
ware assigned to the treatment group and each of the two control 
groups were comprised of 26 students. All participants were 
individually administered Kitchener and King's (1985) Reflective 
Judgment Interview (RJI) as pretest and posttest . 

I n s t r ume nt at ion 

Reflective Judgment Interview: An Overview 

The Reflective Judgment Interview (RJI) is a copyrighted 
instrument that includes four ill-structured problems and a set of 
standardized probe questions. Copyrighted scoring rules are used 
to score each individual's response to the interview and, in 
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general, inter-rater reliability has been moderate to high, 
ranging from 70% to 80% in most samples (Mines, 1982), 
Interviewer certification and rater procedures have been 
established and can be obtained by contacting Kitchener or King; 
mailing addresses are provided in the Kitchener and King 1985 
citation. 

The Reflective Judgment Model is based on the work of Perry 
(1970). The model describes the shifts that occur in assumptions 
about knowledge and in the way a person justifies his or her 
beliefs and decisions. Perry's original model consisted of nine 
positions, which ranged from basic dualism. in position one, to 
committed relativism in position nine. Kitchener (1977) and King 
(1977) collapsed the nine positions into seven stages, which 
describe a series of changes that occur in the ways adolescents 
and adults understand the process of knowing. These seven stages 
range from dualism in stage one, to multiplicity in stage four, to 
relativism in stage seven (see Table 4). 

The Reflective Judgment Interview format is a 
straightforward technique which can be used to assess a person's 
level of reflectivity. First, an ill-structured problem, called a 
dilemma, is presented to the interviewee. There are four 
dilemmas, which are drawn from the domains of physical science, 
social science, biology, and history. Examples of the standard 
RJI dilemmas follow. 
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Some people believe that news stories represent unbiased, 
objective reporting of news events. Others say that there 
is no such thing as unbiased, objective reporting, and that 
even in reporting the facts, the news reporters project 
their own interpretations into what they~write.' 

There have been frequent reports about the relationship 
between chemicals that are added to food and the safety of 
those foods. Some studies indicate that such chemicals can 
cause cancer, making these foods unsafe to eat. Other 
studies, however, show that chemical additives are not 
harmful and actually make the foods containing them more 
safe to eat. ^ 

Many religions of the world have creation stories. These 
stories suggest that a divine being created the earth and 
its people. Scientists claim, however, that people evolved 
from lower animal forms (some of which were similar to apes) 
into the human forms known today. 

Most historians claim that the pyramids were built as tombs 
for kings by the ancient Egyptians, using human labor, and 
aided by ropes, pulleys and rollers. Others have suggested 
that the Egyptians could not by themselves have built such 
huge structures, for they had neither the mathematical 
knowledge, the necessary tools, nor an adequate source of 
power. They claim that the Egyptians were aided by visitors 
from other worlds. (C. Lynch, personal communication, Sept. 
20, 1991) 

The task for the respondents is to explain and defend their 
judgment about the issue and, in addition, explain in what way 
they know their belief to be true. Responses to these issues are 
elicited through semi-structured probe questions. The probe 
questions are designed to help the respondents elaborate on their 
ideas and clarify their answers. The following probe questions 
are asked: 

1. What do you think about these statements? 
2 ♦ On what do you base that point of view? 

3. How did you come to hold that point of view? 

4. Can you ever know for sure that your position about 
this issue is correct? How?/Why not? 
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5, When people differ about matters such as this, is it 
the case that one opinion is right and one is wrong? 
Why?/Why not? 

6. Could you say that one opinion about this issue is in 
some way better than the other? How? /Why not? 

7* How is it possible that people can have such different 

points of view about this topic? 
8. What does it mean when experts in the field disagree 

about this issue? (How do you explain or understand 

such disagreements?) (C. Lynch, personal 

communication, September 20, 1991) 

The responses to the probe questions are scored through the 

use of the Reflective Judgment scoring rules (Kitchener & King, 

1985). Scoring is usually conducted by two certified RJI raters 

who evaluate the respondent's assumptions about knowledge, 

certainty of knowledge, use of evidence, and nature of 

justification. Responses to each of the questions are scored, 

using a three digit code. The first two digits represent the 

dominant and subdominant stages used in the response. The third 

digit is used to weight the dominant stage. In order to make 

group comparisons, a mean score for each respondent is derived by 

averaging scores across all dilemmas and both raters. According 

to Kitchener, King, Wood, and Davison (1989): 

using the three-digit summary code for each problem assures 
that raters are assigning an equal number of scores to each 
problem and that the frequency distributions of subjects' 
scores at each testing have equal n's; this facilitates 
comparisons of individual change over time. Some stage 
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models, for example, Colby et al. (1983), have used a two- 
digit code to summarize responses to a problem. With such 
codes, if more than two stages are used in scoring a single 
problem, they cannot be represented in the final score. The 
three-digit code more accurately allows subject variability 
to be represented, (p, 79) 

For this study, 474 student interviews were conducted; each 
interview was audiotaped, transcribed, and submitted to the two 
RJI certified raters for rating. This researcher was trained and 
certified by Dr, King (i,e,, one of the original RJI model 
developers) and conducted all student interviews. Through this 
process, pretest and posttest ratings were established and 
comparison scores were made between the three groups. 

Data Source 

Statistical analyses were performed using multiple 
regression and analysis of covariance (ANCOVA) which produced F 
ratio statistics, associated probability levels, and the grand 
means of control and treatment groups. All means and standards 
deviations were rounded to the nearest thousandth. Computations 
for data analyses were conducted on an Apple Macintosh SE computer 
using the FAS TAT Program (Systat, 1989). 

Results and Educational Importance of the Study 
The most significant finding in this research was that, for 
the first time in reflective judgment research, a purposefully 
structured one semester intervention resulted in epistemic 
development. Students exposed to the one semester developmental 
instruction approach had statistically significant higher 
Reflective Judgment change scores in comparison to students who 
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were not exposed to such an approach. An analysis of covariance, 
controlling for the pretest scores, on gain scores for Treatment 
Group 3 versus Control Groups 1 and 2 was conducted. A 
statistically significant difference between groups was detected 
(F = 14.594, df = 1, £ < 0.000). The gain for Treatment Group 3 
was from 3.234 on the pretest to 3.530 on the posttest, a gain of 
.296 of a stage (see Table 5). 



Table 5 

Group Means and Standard Deviations for Reflective Judgment Pre- 
and Post-Interviews and Gain Scores 



Group 



Control l a Control 2 b Treatment 3 C 

(n = 26) (n m 26) (n = 28) d 

Mean SD Mean SD Mean SD 



Pretest 3.585 0.301 3.587 0.340 3.234 0.301 

Posttest 3.442 0.282 3.471 0.300 3.530 0.264 

Gain -0.158 0.233 -0.116 0.308 0.296 0.308 



No. 9 . a Control Group 1, students not exposed to RJ-DIM. ^Control 
Group 2, students not exposed to the RJ-DIM. c Treatment Group 3, 
students exposed to the RJ-DIM. d Total n = 80 students. 
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The second significant aspect of this research was the 
development and implementation of the Reflective Judgment- 
Developmental Instruction Model (RJ-DIM) (Kronholm, 1993), which 
can be credited for the positive gains found in this study* The 
creation of this model was an attempt to do what Kitchener and 
King have not yet done. According to Kitchener and King (1990b), 
"Our work has been primarily on developing and empirically testing 
the reflective judgment model. ♦ ♦ We have not developed or tested 
a program designed to help students examine their own epistemic 
perspectives" (pp. 171-172). 

Recommendations 

Research Recommendations 

1. Contrary to prior Reflective Judgment research, it was 
found that carefully structured, one semester interventions were 
effective in this study* However, the research sample in this 
study was comprised of only 80 undergraduate students ♦ While 
these numbers are comparatively large for a developmental study 
using an interview format, the sample is still a small one from 
which to generalize results. Gathering additional data with other 
populations should receive a high priority. This study should be 
replicated: (a) in other courses, (b) at the graduate level 
instead of the undergraduate level, (c) at other universities, and 
(d) in other demographic areas. 

2. A longitudinal study should be conducted to examine 
the effects of a developmental instruction approach over time. 
The findings of this study indicate that reflective judgment 
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levels can be enhanced by purposefully planned curricular 
intervention. Development of articulated undergraduate programs 
which would allow for research to compare the longitudinal effects 
of repeated exposure to specific models, such as the RJ-DIM, are 
highly recommended . 

3, A qualitative research study should be conducted with 
particular attention directed to students' progress which is not 
necessarily reflected in the Reflective Judgment Interview 
ratings. As Kitchener (1992) pointed out, while the numerical 
differences may be small, the qualitative differences are . 
important onr?s. Closer analysis of such qualitative differences 
is highly encouraged* 

4. Use of the Reflective Judgment Interview approach for 
student assessment i3 both expensive and time consuming. 
Interviews must be scored by trained raters and the current cost 
of such ratings is approximately $18 per subject for the pre- and 
posttests. With two raters, this cost is doubled. Ratings are 
carried out through use of the transcribed interviews and 
represent another major cost issue with such a project. 

Although some educators view an objective measure of the 
Perry scheme as an oxymoron (Moore, 1991), perhaps an objective 
measure for the Reflective Judgment Interview should be attempted. 
Two major advantages of utilizing an objective measure are: (a) 
the ease with which such instruments can be administered and 
scored, since trained raters are not required to score the 
instrument, nor is it necessary to work from elaborate rating 
manuals; and (b) the cost factor. Because objective measures are 
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much less expensive than interview formats, these instruments can 
be used to gather more extensive data in large-scale studies, such 
as an assessment of college outcomes* 

Educational Recommendations 

1. The Reflective Judgment-Developmental Instruction 
Model (RJ-DIM) (Kronholm, 1993) represents one effective method 
that facilitates cognitive development ♦ The inclusion of this 
methodology in other undergraduate courses is highly recommended ♦ 
Although the lesson ideas included in this model are based on 
environmental issues, the RJ-DIM approach could be applied easily 
to issues for use in courses such as health, social studies, 
agriculture, business, law, and home economics* The use of this 
strategy in other areas would not only promote reflective thinking 
but could perhaps have a multiplier effect if a student was 
exposed to the approach in more than just one course* 

2. Knowledge of the levels and sequence of reflective 
judgment can help provide teachers with some of the tools 
necessary to understand students' cognitive orientations and 
promote their intellectual development* However, knowledge is 
only one of the first steps. Application of this information in 
the classroom setting is crucial if any real change is to be 
realized. Preservice teacher training programs should link 
developmental theory to developmental instruction models. 
Training programs should include the development of instructional 
approaches which would equip future teachers with the requisite 
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knowledge and skills to adopt and incorporate such pedagogical 
techniques in the classroom. 

3. The results of this study, along with the previous 
research cited earlier, have produced a solid research base which 
indicates how one aspect of higher order reasoning, reflective 
judgment, develops. Using this research base, specific 
pedagogical approaches (e.g., the RJ-DIM) need to be developed, 
refined, implemented, and examined. Finally, in order to evaluate 
the extent to which such approaches are successful, the Reflective 
Judgment Interview can be employed as an assessment tool. 

4. A Reflective Judgment Network should be established. 
Such a network could serve as a support group for people 
interested in research, pedagogical approaches, and curricular 
interventions related to reflective judgment. Acknowledging that 
teaching and educational practice is problematic, complex, and 
uncertain encourages critical analysis. Such an analysis is 
needed if the gap between what practitioners think they are doing 
and what they are actually doing is to be reduced. Collaborative 
work in the field of reflective judgment could help change a 
school culture that promotes the following hidden curriculum 
objectives . 

The teacher 'teaches' and the students 'sit and listen' or 
' learn ' pass ively . 

There is one 'right answer' to any question, and it is in 
the book to be read. 
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The answer to most questions can be given in one or two 
words, and no one will challenge you to go much deeper. 

Books and teachers are always 'right,' and we learn only 
from them, not any other resource in the room, such as our 
friends. (Barell, 1991, p. 237 ) 



In contrast to the findings from previous research conducted 
in Reflective Judgment, the data analyses from this study provided 
evidence that the treatment group (i.e., Group 3), which was 
exposed to the one semester developmental instruction approach, 
had significantly higher reflective change scores when compared to 
the two control groups (i.e., Groups 1 and 2). The Reflective 
Judgment pretest mean score for Group 3 was 3.234 and posttest 
mean score was 3.530, a gain of .296. While the numerical 
difference may not seem dramatic, the qualitative difference is an 
important one. This gain score reflects a shift to a style "of 
reasoning whereby the individual begins to use evidence to make 
judgments (i.e., Stage 4), as opposed to a reasoning style that is 
based solely on personal beliefs (i.e., Stages 2-3). 

Research findings in the area of cognitive development have 

demonstrated that one semester interventions can be effective. As 

an example, Enright, Lapsley, and Levy, Jr. (1983) found that 

subjects who were exposed to a one semester, Plus-One discussion 

strategy gained approximately one-quarter to one-half of a Moral 

Judgment Interview (MJI) stage. They stated that: 

the first strategy to emerge and the least complex, although 
possibly the most difficult to implement, is the plus-one 
exchange. Here, the educator, through modeling of ideas one 
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level above the student's current level, attempts to induce 
cognitive disequilibrium and eventually to stimulate growth 
to the next higher moral level, (p. 44) 

Similarly, the pedagogical strategy of Plus One discussion and 

cognitive disequilibrium was utilized in this study and is an 

integral part of the RJ-DIM (Kronholm, 1993)* 

The necessary effort to encourage students to think at 
higher levels of the Reflective Judgment model (King, 1977; 
Kitchener, 1977) requires an effective balancing act between the 
provision of appropriate challenges and support to students who 
are at dissimilar stages of cognitive development. The RJ-DIM 
(Kronholm, 1993), which is based on support and challenge, 
provides an instructional approach that educators can utilize to 
create more meaningful and intellectually stimulating classrooms ♦ 
Because this model depicts the learning environment and outlines 
the strategies which instructors can use to promote higher levels 
of reflective judgment, educators may be persuaded to think about 
their interactions with students and develop strategies that more 
effectively teach students to think at the higher levels ♦ 

The factors of support and challenge are integral to the 
development of reflective judgment, A major purpose of this 
presentation was to provide the requisite support (i«e*, 
explication and operational heart of the RJ-DIM) in order that 
faculty can consider an integration of the RJ-DIM in their 
pedagogical approaches • The challenge hereby presented is that 
faculty reflect on this new model and consider how the RJ-DIM can 
realistically be incorporated into their present approach to 
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instruction and facilitate the process of student learning. As 
the ongoing research in Reflective Judgment continues, the use of 
the RJ-DIM by individual faculty can facilitate the acquisition of 
new knowledge. 
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